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prof iciency guidelines and that can serve as an alternative to the 
live interview in situations where the interview is not financially 
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detail are provided to serve as a general guide for the preparation 
of similar tests in other less commonly taught languages. The 
conceptual and practical questions addressed in the handbook may be 
applicable to other languages even though different languages may 
present somewhat different measurement needs. A questionnaire for 
participants in the Chinese Speaking Test Study is appended. (MSE) 
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OVERVIEW 



During 1984-1986, with funding support from the U.S. Department of 
Education, the Center for Applied Linguistics (CAD developed and validated a 
!^ rie !«° of speaking proficiency in Chinese that lake use of a "semi- 

direct procedure. This is a procedure in which the test stimuli are presented 
to the examinee through a tape recording and associated test booklet, rather" 
than through direct face-to-face conversation as is the case with the ACTFL/ILR 
oral proficiency interview (OPI). Although the OPI procedure has been used 
extensively and with good success for several of the languages most widely 
taught in the United States (e.g., French, Spanish, German), the relatively 
small student enrollments in the so-called "less-commonly-taught" (LCD 
languages-together with the associated limitations on material and personnel 
resources within these language areas— may often make it difficult or 
impossible to establish the necessary infrastructure of highly trained 

1! ![n!l! er/ I 4ter V? " ndUCt inter view-based testing or, by the same token, to 
establ sh and maintain a suitable mechanism for the monitoring and quality- 
control of the testing process. H y 

It was the intent of the CAL project to develop an alternative approach to 
speaking proficiency testing that would be operationally practical for use in 

J?TnInJ n?U f ge setting ' Dut at the safte highly congruent with the regular 

ACTFL/ILR interviewing and rating procedure in terms of both the types and 
extent of language use elicited in the course of the test and the nature and 
interpretation of the testing results. In keeping with these goals, the 
project developed four alternate forms of a tape- and booklet- mediated Chinese 
speaking test, designed to be administered either in a student recording- 
capable language laboratory or in a regular classroom using two portable tape 
recorders, one to play the master test tape and the other to record the 
student s responses. The four test forms were subsequently validated by 
administering both the project tests and a live face-to-face interview to the 
same groups of students and determining the degree of correspondence of the 

a tained °" both t tv P es of instruments. The statistical indications from 
this study are that, with properly trained raters, the semi-direct tests can be' 
administered and scored as reliably as the face-to-face interview, and on this 
basis can be used as effective surrogates for the live interview in situations 
where face-to-face testing is not financially or administratively feasible. (A 
detailed^description of the validation study and its results are available in 
the final project report, "Development, Validation, and Dissemination of a 
Proficiency-Based Test of Speaking Ability in Chinese and an Associated 
Assessment Model for Other Less Commonly Taught Languages" [U.S. Department of 
Education Grant No. S008402258J, 1986, available from {he Center fo° Applied 
Linguistics.) KP 

n„ fh! h Ho PU ^ P ° Se V, the P resent handbook is to document and provide commentary 
on the development/validation activities carried out for the Chinese speaking 
tests insufficient depth and detail to serve as a useful general guide for the 
preparation of similar tests in other less-commonly-taught languages. In this 
regard, it should immediately be acknowledged that the implementation of a 
similar test development project within a different language or language family 
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DIRECT VS. SEMI-DIRECT TESTING 

proceSure^s^e^ SlrSSTh^iSir^ f lark f (I979 '« a "«r.it- testing 

given exa.inee, both to pres nf th t s t" iZ'nlT r "''l'?" b8Sis " ith a 
simultaneously evaluat-o th. - • . "lauli and (in most instances) 

of thi exa.inee by .eans o" o?i^tId h»L7l^ f * Ct,v * Sp " ch ° n th « P art 

A major advantage of the direct test — fnr yhi^h *k 
interview (OPI) is the priaary4x7^1 e--i s tZ mI?h P r ° ficiency 
procedural validity which U embo" As " e f» 1? ° VaHdity and 

competence in a conversational set ing it f. I?!!- ,! ' er,unin 9 s P"king 
realistic testing approach than LtuaJlv Li dlff <; ult to "nceive of a .ore 
The interactive nature o 1 iZ c nv r atiL^V V**' 1 "" in ""^ersation, 
examine's part, of the i Hac o b ^ f -".n.tr.tion, on the 
variety of discourse management strafeaies I 1 fPP ro P r ^tely a 
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...i-direct econi , .2.,.,.?' tS J.'u.i ff"' '«»•»•«" through 

that certain tynes of I I '"tbtioi, notmthstanding, it is felt 

referred to a SrofUi."' J A "J"''""' " hi,:h <°r convenience can be 

scored and interpreted on the basil o f lht !,,V l ^ interVieW » and (2) is 

other functionally simil r s > 1 ^ ^^^^iency guidelines or 

was planned and devel npr il «j L |, theie ■ it! 1 . 0656 S ° eakin 9 T »<> (CST) 
numerous discussions that «rp hpfn V constantly in mind, and the 

as well as the inSivi ^^t^n types^C 1 ^ IV'T" ^ <° r the test 
touchstones the two interrelat qu on "How n'w' til " '"V* 1 
elicitation procedures and cont a , „Ii !„! : .- . 6 best *PP r «"<iiiate the 
interview through t v c e ^"I 15 °* a well-conducted live 

extent will a proposed f 0 ffla t or ouest an" ^ ^ bookl «t?" and "To what 
response that can be ef ic?entfv Tnl riu ^ te ?° to «Hcit a student 
ACTFL/ILR scale'" etf ^iently and reliably evaluated on the basis of the 
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A MAJOR CAUTION 

this hSaS'US r V the " aterial contai - d «« 

nell as considSrable'-hands-o" i;;;;?.""!?!"?!, • Bd V™" 1 ""ground-as 
and rating as both of these aTm« EIulT ? ° 1 P roflcl ency interviewing 
on the Teaching of ?or.i« UmJJoS !aSJi"i e ? ab ° rated ^ the A.eric.n Council 
Testing Service (ETS) , 2e InUra a " r ! . I " njl,ncti °" -ith Educational 

for Applied Linguistics (CAL1 IS'SJI Language ^"dUble (ILR) , the Center 
role in the develo me ffl .u 0 n ^1.? 10 " S that have P la ^ a "Jor 

Although the information prov 3" M°" °1 Jf 1 5 « easure ^nt technique, 
detailed as possible within nlc!«lr workbook is intended to be as 

this materia? CANNOT 1 o# ItSlJ lllllot" h C ° nstrai " ts ' ^ of 

faailiarity with oral proficiency tlst?no con%L' e T"^ backsround and 
that would be needed to proper^ int^rl * ! Procedures in general 
information presented Per son! ilt J ret * nd Bake effective use of the 
aid to test e t sh 0 u° ^J!?.* 0 UM °< this "° rk °°° k a * *n 

full-scale ACTFL-s on .or erTTe^eTTr^ a 

language of the test or whirl nil training workshop either in the 

conceptual foundations* proflcle "cy intervi.ning/ratin, process and its 



OVERALL TEST FORMAT! SOME BASIC CONSIDERATIONS 

l»tl.M" -"'.^ttW'SJ the -""cation 0, th. over.,, 

tne desi,n „ al.n^tests Z'r other V££™ *" »'•«"' " 

■ r»anUd ^ u P L°u'.ru^ '^^r;;^:^ '" J"' ■>" j - h 

a T a aastar audiotape * ' *"' °' ' I ' -- let a ~ »el_l_ 



recorded questions in tne W n . f!l' ? consists of a series of tape- 

orally one-bv-on/d an ? Ua ? e ' " nicn the student is to answer 

question-answer #o?..t?5b.5?b^ tape. Although this 

questions across a vari.i 0 to iL reH f e a ?T nt 0f """i " ty, " in that 
can be posed, it has several drawbacks r d at levels of difficulty 

sophisticated questions it i! in« -J?' *l I ' es P eci ally for the more 
understand the nStu?2 2? '''intint P ta! S f "a.inees eight not fully 
question, even thou 1 { e " t ° a f;;; 8 -^ target language 

respond appropriately to the idenHrfl " , ent S P eakl "9 proficiency to 
(e.g., printed in a test took let) ll liV J"" presented in s °* e other manner 
or ^understanding of a sp^ 

examinee can ask for renttiXZ ^ f. noc as a problem, since the 

-..etc. „.„ ver , S^iK! '^^/JTSrSpiJtL," .7fS 
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supple.ented by the ose of . J ^ "i?":, S'j "I ( r'.lT' r '?J M '* 
prov old 5m of i !* C f ry ° at °" the """iption 

s. provide s:.:'.!,; , r '• ^ P ;: i mJ^^s^j^tt not .r y - 

of other printed or pictorial ..t.ri.l' nUndl. u , , , V*,.' \, ,tr,,t ' 

Superb, T on l^'.? 0 "!?, Hal ■ to 3> rahoe Hole | 

selection IVll'l '° "'" 5her th « tended test range, the 

f 5 3 1 i;; 1 ,',;;'; »"^ted by the ...,! d j rie h ; „„„re 

• . .. . • ievei * ana aoove, the examinee s proficiency i* c,, r h fk*f 

wmmmmm^ 

face- and content-valid co.oonicali, S s ^ e i' 

il p r r " ' 5 ° ti :° e e ;h"ae 0 "vp S e"'oI in b ° dy ."^"serve to 

accepts o^H:;-^, t ^^^rc^i""n"h: e f:„ e ^:: iye - s °* e 

i f*f-^.°* I""*'"" Hi the teat should be .....r,>i. lt leJtt , 

e.n,.al fasn.on, oy .,..,„... at the lo j , level „ „, th ' ^ ^ 

<.f»i™'-'I!?fh t .fl'!J rt "° uld "•""•riiy be ad.inist.r.d in a linear 
fashion, «ith all exaainees, regardless of oroficiencv level ••»...." 

i . teJrilT; « "?* "h.id.rod i.portant " e I . ' ' s " 

' lotT n S Th°" least so.othin, in rlsponse o each 

1U " tasKs, e.g., making appropriate 
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after-dinner remarks in a highly formal setting, even level 1 examinees would 
be able to say the target language equivalent of "Thank you, like very much, 
hope come again," etc. ' 

4t Wherever possible, each question should provide the opportu nity for 

more sophisticated a nd elaborated responses on the c art of higher-level 

exami nees. a 

It was acknowledged that certain questions on the test would necessarily 
fail to elicit a full level 1 - 3+ range of responses because the topical area 
and/or the communicative requirement was intrinsically at a lower level. For 
example, in the conversational portion of the test, questions such as "Where do 
you live?" would not be expected to probe beyond level 2, since this is not a 
situation in which even educated native speakers would normally produce a 
beyond level 2" type of response. However, to the extent possible, each 
question in the test was phrased so as to include some type of cue that would 
alert the more proficient examinee to the desirability of making a more 
elaborated response. For example, one question asked the examinee to describe 
the typical day of an American office worker, based on a sequence of line 
drawings. The additional instruction, "You may wish to add some appropriate 
social commentary," was intended to elicit some discussion of the overall 
American work ethic, the fast-paced "lunch at your desk" syndrome, etc. which 
was clearly implied in the drawings and would be a natural topic for comment by 
examinees having the requisite level of proficiency. 



5 " The test should follow the no rmal progression of the live intervi ew 

with resp ect to both the kinds of questions asked and the level of 

sophistication targeted by these questions. 

Just as the live interview is intended to progress from eliciting 
relatively simple factual information in an autobiographical mode up through 
progressively more sophisticated types of language performance, the CST was 
designed to follow a similar general sequence of autobiographical information, 
narrative descriptions, past-time and future-time descriptions, responses 
requiring comparisons, supported opinion, discussion of hypothetical 
situations, etc., up through a final series of role-playing situations 
requiring tailoring of content and style of speech in keeping with the 
sociolinguistic characteristics of each situation. 

. 6. With the single exce ption of the target language questions in the 
live conversation" secti on of the test, all test directions and test s timuli 
should be in English^ . ~~ — ■ — 

This consideration was definitely not. in keeping with conventional or 
traditional approaches to testing within the Chinese field, in which the use of 
English is characteristically avoided except possibly for the initial general 
(whole testVrdirections. However, it was felt that presenting the test 
directions-'on the individual question stimuli in Chinese would run the 
substantial risk of having the examinee not understand (or only partially or 
erroneously understand) the specific speaking task at issue and thusfare 
poorly on the test-the actual level of speaking proficiency notwithstanding. 




For the higher-level questions especially, where it -n.,in k 

ZuTher'le, so "* P ' eUly iUCk «S P "i. ess 

conversational section in -h M \l 5 l "'' h single exception o< the 
inappropriate on (.« . L 5 approach "oold be quite artificial and 

o. th.., r ;„ , ,; ru ° c "t!* n c * o .? ,„ 9r :, n ,* r." ..'o«:» b r * provide „. t 

of not understands or .i,i.IU.f!.!. ?! 5 Poken for.--the student's chances 
«ere appreciab" reLed """ ' hC re """-"< '"Ponse tasks as such 



person would like to find out 111 ll n » lth : a ™tiye speaker of Chinese. This 

and interests. For elc qu ° t oTa 9 y Se Ch^n^'^^T^'^^^^""' 
carefully and answer duril ?J by the Chinese speaker, listen 

rcsaa^r^s; '--'--'-^ou^in-^r;;: 6ut 

as possible aoout'tne , " „ 'ca^do'th & ^ThlsV'nr' ** """ 

lurcfe^ 

question" Usf S ec P tion. y 6 d ' S " UrSe to a particular 



OVERALL TEST INSTRUCTIONS 



The general instructions for the tect uhirk j 

ass r 

.n.".?'.!'',^.?!.^ c'Xut.lj! ;'»*""~«'>» ""<"<. •»■ "0 one is ejected t. 



re 5 pon^e^i:: c a M n u e : 8 Uo 0 :! d " t0 ,pM " iB " ^ as possible in 

n A ^S U rp C i U J ed / re T e ! inderS t0 Speak loudl y enou 9 h and Nearly enough to 

ctder i °i « y re " rdi ri " 9 ' and t0 fflake ^ that the exal s ape 

before [he test begin:"'" ^ Mvin " thr °^ h the 

Chin-^I °! t he j ite »-type sections included in the final version of the 

reproduced in full, together with .aster tape scripts,' in AppenSiJ fl. 
PERSONAL CONVERSATION 

3J * to each^question as it is asked. The scenario estabished for this 

• Approximately 12 questions are asked in this i„ti„ >,„_• ■ 
very fi.pl, questions (t.roet l.nquaqe equivalent of •H.U,' til r ' "UJ „ 

ma * T J e f s Po^n questions should be phrased in a natural and idio.atic 

!m hL* f f S J? Uld USe V6ry C ° mon lexic °" and structure, so that ?K examinee 

Siitlll!-;. ■ " " diHiCUlty -standing the .eaning/ incen t ol elcT 

n{ a * f ach .^"tion should be applicable to the actual biographical exnerience 

this section should have "present trutn-vJ np« *^ fh d ' BaCh quMtlon in 

requireaent appreciably narro.s g^^^^g"? ^"SSui.* 
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to the live interview, which can be adapted on a real-time basis to the 
particular background of the examinee), some care in phrasing can help to 
insure adequate general i zabi 1 i ty. For example, instead of asking -Where is 
your house located?" (presupposing a type of lodging that many student 
examinees might not possess), the question could be phrased "Where are you 
living at present?," which would embrace any and all types of housing. 

• Conversational rejoinders, if any, made by the tape in "response" to the 
examinee r preceding answer must be a reasonable, or at least not illogical, 
reply to whatever the student may in fact have said. For example, to a "Hello, 
how are you? question, a taped response of "That's good" would not be an 
appropriate conversational follow-up for an examinee who had justTompl ai n*d 
about a splitting headache or who had expressed great anxiety about taking the 
test. In general, because of the difficulty in judging ahead of time the 
variety of examinee responses that might be made to a particular taped 
question, conversational "rejoinders," although frequent in live conversation, 
are probably best avoided in a tape-recorded context or employed with extreme 
care. Although an occasional intentionally vague and "all-purpose" reply such 
as the target language equivalent of "I see" (followed by the next question) 
could provide for some conversational naturalness, this is probably about the 
limit of the feasible in a semi-direct mode. 

a Careful response pause timing is critical if the "conversation" is to be 
reasonab y natural. In the Chinese versions, typical pauses ranged from 6-7 
seconds for the initial short questions ("Hello, how are you?") to 
approximately 20 seconds for the more discursive questions involving narrative 
descriptions^ comparisons (e.g., "Do you like to eat restaurant food or horns 
cooked meals? Why?''). If possible, a clinical tryout aimed at, among other 
things, determining the appropriate pause lengths, should be undertaken. This 
can be done by recording each of the conversational questions end-to-pnd 
(without pauses) on a trial tape and-on a one-to-one basis with 8-10 examinees 
typical of the full proficiency range envisioned for the test population- 
starting and stopping the tape as necessary for each examinee, and recordinq 
the response times actually used. Experience with the Chinese test suggests 
that, for any given question, response times near the high end of the observed 
range are preferable to shorter pauses since examinees, for the most par* are 
more frustrated by being "cut off" during a reply than by having some seconds 
of waiting time prior to the next question. 

PICTURE-BASED DISCOURSE 



This^section is characterized by the presentation, in the test booklet, of 
both single line drawings and sets of 4-5 topically-related "picture 
sequences." Both the individual pictures and the picture sequences are 
accompanied by spoken English questions on the master tape. In the Chinese 
tests, two single-picture items were included in each test version, wi*h the 
first of these intended to check the examinee's ability to give simple 
directions. As in all parts of the test, the picture-based tasks are set 
within genuine communicative "scenarios." For example, the "giving directions" 
question for one version of the test was phrased as follows: "Imagine that you 
have invited a Chinese friend to come to dinner at your house, which is a few 
miles out of town. You need to give your friend directions over the telephone. 
These directions are shown by a dotted line on the map. You will have 15 
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seconds to study the nap. Then, when you hear a tone signal, tell your friend 
how to drive fro. his house (which is marked by an X at the bottom right) to 
your house. " " ' 10 

The second single-picture question for each test version was aimed at 
checking the examinee's ability to provide detailed descriptions, and included 
a rather complex scene involving both common and higher-level lexicon. A 
typicfiV scenario: "A Chinese-speaking friend has expressed an interest in 
taking her children to a recreation park in your neighborhood this coming 
weekend. She is very interested in knowing what facilities are available in 
the park and , ^general, what kinds of things there are to do there. Y 0U will 
have 15 seconds to study the picture. Then, when the signal sounds, tell your 
friend as much as possible about the park and what one can do there." 

With regard to the picture-sequence itens, the final version of each of 
the Chinese tests included three sequences— the first intended to -licit 
descriptions of habitual activities (in present time) the second, a past time 
narration, and the third, a future time narration. Typical scenarios incited: 

(Habitual action:) 
A typical day in the life of an average American office worker. 
A typical school day for an American elementary school teacher. 
A typical Saturday for an American family. 

(Past time narration:) 
A traffic accident. 

A series of unfortunate events during a hotel stay. 
Transportation problems in trying to get to a meeting. 

(Future time narration:) 
Plans for tourism and shopping during the coming weekend. 
Plans for things to do with a Chinese friend visiting the United States. 
Plans for a backpacking trip in the countryside. 

a •• F0r . b S*{ Sinale -Picture and picture-sequence drawings, the style, 
degree of detail and other visual aspects of the drawings are crucial to the 
measurement validity of the test questions. The following points should be 
noted 1 

.. Drawings are preferable to photographs in that (1) photographs usually 
contain extraneous and confusing detail that can often -hide" the particular 



Vrl 111* 9 J * f ! f* are m05t at issue in the test} and (2) if photographs 
are used, the test; developer .ay be teepted to test whatever kinds of things 
happen to be exemplified in available photographs, rather than carefully 
specifying ahead of time the intended linguistic situations and anticipated 
student responses, and tailoring the test stimuli to meet these requirements. 

e Since both men and women will be taking the test, the -protagonist" in a 
given picture sequence (if intended to represent the examinee) should be drawn 
fh,M! niSeX char " ter t0 the greatest extent possible. Slacks/trousers (rather 
litL dreSses or obv !°"sly male suits), hair of a length that could be worn by 

s cul !H : !! I J;!!fr k h 8 ! 1 COntribute t0 this effect. By the same token, the 
station itself shou d be one m which both men and women would be equally ; 
likely to find themselves. [Note: These considerations apply only to those 
situations in which the examinee him/herself is represented in the drawings and 

?hp 1 -«! :Per ! 0n n ; rrat ! on .i 5 at iss ". When third-person narration is intended, 
the main character- in the drawings may be obviously of either sex.] 

a „H A "J^ied cartoon style, in which the people are shown in a simplified 
and stylized but not -funny-) manner, is preferable to more realistic and more 
comp ex depictions. The scene itself should also be highly stylized and 
simplified to the bare essentials necessary to convey the intended information. 

rhino! F r ? ra, * in9S | nt !!! ded to elicit -giving directions," experience with the 
Chinese tests^suggests that an oblique view of an actual scene (cf. p. 1, Forrv 
U) is preferable to either a genuine map or a stylized bird's-eye map). The 
reason for this is that both the genuine map and, to a lesser degree, the 
Dird s-eye drawing put a premium on the examinee's ability to "read maps"-an 
?„r a Jf° US faCt ° r insofar as target language proficiency per se is concerned. 
IrLl Ik"" 6 P ers P ec t lve Provides a "mind's eye" view of the intended route and 
such sxafflinee *ro« the potentially confounding chore of map reading as 

nh io .f F ° r dr t" in . q * intended as stimului for detailed descriptions, enough 
objects or activities should be depicted to allow for an elaborated response on 
the part of more proficient examinees, without completely frustrating the less 
inTdf! ! fc exa,nin f es ' For exa »Ple. in Form A, p. 2, the neighborhood park scene 
includes a variety of linguistically sophisticated items from a learner's 
perspective (snack cart, children going down a slide, sand box, etc.) that 
Hu6. n S i'V'l .1 relate !.° r at least readil V Paraphrased by a higher-level 
-JlS?!' J f^f"* J" alS ° includes other easier items ("swimming, - 

playing tennis") that would be within the ability of a less proficient 
examinee. 

Close and effective communication between the test developer and artist is 

sunnpsf h inSUre K that the drawinos "e of the highest measurement value. A 

suggested approach is as follows: 

»*t..rI 1) /il-*J ti ! t t s J ould b e informed in detailed but -lay" terms about the 
rlii 1* L f "I' 6 496 and background of the anticipated examinees, the 
lAlilt the line drawings in eliciting certain types of responses on the 
w^ch L!f r ; Hi 1 P° s h sibl f. the artist should sit in on a session in 
which several of the picture-based questions are discussed and planned. 
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artistic coipeUnc !! he I .?? J# JK J" ° , vlsu f lizatio " ^ility and some 

«M at thil stage, a clinical 1 ■ , 'nked draumgs are prepared, 

native speakers to ans.er cue int^nL ? conducted by asking a nu.ber o( 
provided. For each picture or guestions on the basis of the dra-ings 

readily .61. T-ah".' ' lo ° „' ' ?£™> »»" •»«*•'■ =nou,d be 

n as ir:i r the a " s •"»•»' "J. . . - ; . \* c c : ,p l^' 
«.r'."?.,i.? 0 o rsr?h n ; : , ::; , ,7 r,t,ti " °> the «h. 

score level shou 5 be e oertPd P I stand P° int . examinees at a given 

these cult "IT cSJ U F 'e a e " D t C ( St °" e 0r ° ther •« 

..inland Chin, or I. ,, , 'l .tud.nl. using text ..t.ri.l, based on 

mmmmmm 

Srp^^a ,B ^'V^ Picture^:e e d St ;ec 9 ti:n h s e ^^as 

■«itu;t.; p iis ,, ;h:"5's t - Sh;"55 1 : , c s-: ough " - b ^ i : B - e -" • h »» id scenes 

"giving di e 0 ;»"t sef n thVcT'^' F ° r * X *' Ple ' i" For* B, the 

description," in an L i n U ^ e f ^nd^Se^ l" 51 ? 6 '' th6 " detailed 

-Pectivel,, cover' a r ;:; k fj't:e d l^: KTLSc - :; setter, 
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water u 9, B x the P roblems depicted in the drawings (insufficient 

ce r UlJl5 P il , ".I!i i 5 " adj0inin 9 r °°<«. waiter-spilled food) could 
certainly be encountered in either U.S. or Chinese contexts. 

RESPONSES TO PRINTED QUESTIONS 

im"u« i^'uiin ti^TO i*LV',T e reads .? : rinus ' uestio " in 

provided. Th. pri.ar, ."."r..", 6 v " f™" f *«»■ *»• Pf«» 

(Extended descriptions of personal interests and activities:) 
-Please describe the kinds of cultural activities you particularly enjoy." 
"Please talk about what you like to do for recreation." 
"Please talk about the kinds of things you like to read for pleasure.' 

(Compari sons: ) 

woMinMull^r.:?:?" 149 " of being a student (as opposed to 

"Which do you prefer, Chinese or American food, and why?" 

«Talk i( about the advantages and disadvantages of having a television set in your 

(Complex descriptions:) 
'Explain to a Chinese (riend'ho. credit cards are used in the United States. ■ 
Unn^'nt^es."'" 6 " <r "" d h °" ° ne »"" '"'•" N-l > used car in the 

Uni°ld i SUte:.-'' ine " ,rie " d "°" ° ne "° Uld ■» "° ut « .p.rt».t in the 
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(Supported opinion:) 



Explain why." market. Do you agree or disagree? 

-f?"cS" p J:r'i;:ir!c h » c?:,i«i u L°:.r opl ; • r xj* nt » <° mtri " «■ ««». » 

A.erica lies i , ' , ' "!„ \ h ! "fT* * r, "f Ue Stren " h •« 

or.s.nc. of for.i,n4orn wr.on, lith Jnfcn „« It* "t " b *"* m * ,r °' the 
«.t .tr.„ gl y ., r S. ? Giv ° e re«on S L yot'op'nion " P ° 5, "° n5 "°"' d >™ 

(Hypothetical situations:) 

life? Khy aould you choose these particular activities?" "'your 

• r„. """"""-Preparation suggestions and additional discussion of the 
responses to pr.nted questions- it., typ. ar. „y e „ i.V e "A\ ly 

..=tio„^^. ul .^^•.•p u ^^^^^r t , v '.," t D :"., , l f.^ o "• ^.Wi- *"- in «... 
«: ? f . ? < »"»-;rc-:« ""^;e:-po S es 

r.,.rd/ : . puin,.;-^""!.:*' . d • e'„ ■ :d e ""h7K? ij'-sj:;:.. 0 ?; this 

.ppr.pn.t. topic of oi.c.or,. than, for ^X^f^"^ 
foUoJinTcn.air " SUPP ° rted ■"""">"• <«"">» snould undergo each of the 
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- The topic on which an opinion is requested should be one that virtually 
every examinee would have had some contact with through the the media, general 
reading habits, etc. For example, "education for careers" vs. "education for 
personal development" is a "person-i n-the-street " topic that virtually any 
examinee would be expected to have encountered and to have some general 
thoughts about. 

- Topics that are highly controversial or that address potentially 
sensitive religious, moral, or emotional areas should be avoided, including, 
for example, abortion, use of heroic life-sustaining measures, the "right" to 
commit suicide under certain circumstances, etc. Although these matters are 
indeed frequently discussed in real life, the potential "public relations" 
consequences of including items of this type in a widely distributed test— as 
well as the very real possibility of offending or taking aback a number of 
individual examinees—would argue rather strongly against their inclusion. 

- The question itself should be carefully framed, so that the specific 
area of debate/choice at issue is very clear, and at least the broad outlines 
of potential arguments that might bj made (on both sides) are provided. For 
example, instead of the quite vague and undirected "What is your opinion about 
foreigners coming to the United States, and why?," the question actually used 
in this topical area stated two alternative positions —"Some people 

feel. . .difficult for American citizens to get work"; counterposed by "others 
argue. ..cultural diversity." The second formulation, while providing a good 
amount of latitude for the more proficient examinee, also gives needed support 
to the level 1/1+ respondent in the form of broad-outline suggestions about how 
a response might be framed. 

• A major goal of the hypothetical questions is to provide an opportunity 
for the examinee to demonstrate his or her capabilities in discussing concepts, 
issues, and ideas, as distinguished from the more factual topics addressed, for 
example, in the complex description questions. Two considerations in the 
preparation of the hypothetical questions are as follows: 

- To engage the examinee directly in the hypothesized situation, a "first 
person" response is asked for: "Suppose that you were asked to defer ..." ; "If 
it were financially unnecessary for you to continue working...." 

- As is the case throughout the test, potentially emotion-laden 
situations, e.g., "Suppose that you became very ill," "Suppose you suffered a 
family tragedy," etc., are avoided. 

- Notwithstanding the preceding, the hypothetical situation established 
should require some serious introspection on the examinee's part, at the level 
of at least temporary changes in 1 if e-style.or direction. 

- Situations requiring the examinee to assume impossible roles or personae 
("Suppose you were the President of the United States. .."; "Suppose that you 
had just discovered America. . .") should be avoided, both on "real-life 
communication" grounds and on the grounds that examinees would be expected to 
have widely differing capabilities to "project" and "pretend" in fanciful 
situations of this type, regardless of their degree of competence in the target 
1 anguage per se. 
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SITUATIONS 

The last section of the test was intended to correspond, to the greatest 
extent possible, to the Vole-play" activities frequently included at or near 
the end of the live interview. As such, they were considered to offer the 
greatest possibility for determining the examinee's ability to select and use 
the specific lexicon, register, and speech style most appropriate to that 
particular type of situation and, in general, to demonstrate si tuati onal 1 y- 
determined soci ol i ngui sti c competencies not readily elicited in other sections 
of the test. 

The general instructions for this section read in part as follows: "For 
each situation, you are asked to pretend that you are actually in the 

situation, and to respond in a linguistically appropriate manner When you 

respond, be sure to use the type and style of language that a native Chinese 
speaker would use in this situation." The following is a typical "situation" 
question: 

You are standing in line at a train station ticket window in Taipei. 
There are two people ahead of you and your train is scheduled to leave in 
five minutes. Ask the people in front if they could possibly let you get 
ahead of them, explaining the reason for your request. 

To be noted in the above are specific or clearly implicit characterizations of 
(a) the physical setting in which the communication is taking place (train 
station ticket window in Taipei); (b) the inter locutor (s) with whom the 
examinee will need to communicate (Taiwanese fellow-ticket purchasers); (c) any 
temporal or other co nditions potentially influencing th» natnrp or extent of 
the communication (five minutes left before train time) ; and (d) the style or 

tone_ of language most appropriate in this context (although not explicitly 

stated, the "possibly let you get ahead. ..explaining the reason" phrase 
strongly implies an apologetic land rapid] invocation of external extenuatina 
ci rcumstances) . 3 

Across the five situations presented in each test version, there is a 
progressive increase in both the linguistic competence and psycholinguists/ . 
cultural sophistication required to deal appropriately and effectively with the 
situation involved. The earliest questions in this section deal with fairly 
standard" situations in which affectively unmarked and largely conventional 
communicative tasks are at issue, for example: 

You are at the front desk of a small hotel on the east coast of Taiwan. 

Tell the clerk you need a single room with air conditioning and private 

bath. Inquire about the room rate and ask if you can pay by travelers 

check. ': : 

Later situations involve more sophisticated language use in which some degree 
of persuasive or argumentative discourse and/or culturally appropriate display 
of anger, dissatisfaction, or other personal emotion is required: 

You have just finished eating lunch in a crowded, busy restaurant in 
Kaohsiung. In .looking over the check, you find that you have 
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inadvertently been charged for an additional dish you did not order, and 
also that the price of one of the dishes you did order is higher than was 
shown on the menu. Call the waiter and describe these discrepancies. Ask 
for the bill to be corrected. 

Several days ago, you purchased an inexpensive tape recorder from an 
electronics store in Taipei. After using it for several days, you realize 
that it does not meet your needs. You have brought it back to the store 
to ask for a refund, but the clerk is insisting that you exchange it for 
another item of merchandise. Explain to the clerk that the other tape 
recorders in the store are also inadequate for your purposes and that you 
do not really need any other type of electronic equipment carried by the 
store. Explain that you need a cash refund in order to apply the amount 
to a more sophisticated machine. 



On the grounds that proficiency in Chinese at the 3/3+ level requires, in 
addition to other competencies, the ability to perform appropriately in typical 
ceremonial/formulaic settings, one of the five role-play questions in each test 
version dealt with situations similar to the following: 

A Chinese colleague in a school in China has invited you and two of your 
friends to his home for Chinese New Year. You realize that this is a very 
gracious invitation. After dinner, on behalf of you and your friends, 
make some appropriate remarks. In the course of your remarks, thank your 
host and his family for the wonderful meal and for their great 
hospitality. Also extend an invitation to him and his family for dinner 
in a local restaurant next Saturday evening. 

In addition to insuring that the physical setting, interl ocutor (s) , 
temporal or other conditions , and style/tone of the language to be used are 
clearly indicated in the description of the situation, the following points 
should be taken into account in drafting and reviewing the "situation" 
questions: 

• The situation should be one in which the examinee could indeed become 
involved in real life, either as a visitor to a Chinese-speaking country or as 
a host for Chinese-speaking persons in the United States. As with the 
"hypothetical "questions previously discussed, the situations should not 
require the examinee to assume a different persona (for example, a ChFnFse 
head-of -household admonishing family members; a Chinese bus driver giving 
directions to a Chinese passenger, etc.), but should always have real or 
potential "truth value" for an English-speaking, nonnative learner of Chinese 
in a realistic Chinese or U.S. context. 

• Al though the examinee is presumed to have some degree of knowl edge of 
and sensitivity to the Chinese cultural context as this affects the selection 
and del i very of discourse within the particular situation, only the more basic 
and pervasive culturally-marked situations should be presented. Cultural 
situations that a non-native speaker would never or rarely be expected to 
encounter (e.g. , having to say the "right thing" at a Chinese funeral) should 
be avoided as being both too rare and too specialized. 
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QUESTION PREPARATION AND REVIEW 



For all sections of the test, preparation and review of the test questions 
is best accomplished by a group of 3-4 individuals who work as a team for 
initial planning and discussion, subsequently prepare draft questions on an 
mdividial basis, and then reconvene to jointly review and revise the draft 
questions and assemble the draft test foro(s) for trial administration. 
Following are more detailed recommendations for the composition and activities 
of this group. 

(1) The group as a whole should possess educated native-speaker competence 
n the language; experience in teaching the language to English-speaking 
learners; educated native-speaker competence in English; and detailed 
familiarity and considerable "hands-on" experience with the ACTFL/ILR speaking 
12 J i enC \l Cale an ?. rati "9 Procedure. Ideally, all members of the group 
would have these qualifications, realistically, these attributes will be shared 
in different degrees among the group members. 

laftfll ' 2 ' Native-speaker competence and native cultural background in the target 
language is especially critical in preparing and review;. the "personal 
conversation questions and in reviewing the other sections of the test for 

llrlinn J"^ 1 '!-*: , aUVe E " 9lish c0 "P ete "« is critical to the final 
wording of the English directions and English-medium questions/situations. 

ornvidp'^ 0 " Pa ;f te !, P f rallel test forns are considered the minimum needed to 
Ees ill n< ^ 6 flmblllty ,0r » ultiple ^ministrations (e.g., pre- and post- 
e i f '? exa Bln ee group) and to reduce the likelihood of having 

IVtl il I 1 1 <* teSt /T 0riZed " by the students °r otherwise compromised 
within a brief period of time. (The Chinese project developed a total of four 
orms.) Regardless of the total number of forms to be developed, an adequate 
°Ztll, °' ^."""tions should be prepared so as to aUow'for "e ' 
r T atthB review stage or following stages. It is not 

llrl ^rnrH 5 " 9 ?" L" V"! 1 ' P ercenta 9 e figure for "overage," since this would 
mill**?* 9 '° th f 1 technical/li "9" i stic expertise within the group, prior 
Howevir ISI 'T"^ 51-Xlar t6St de velop.ent activities, and so ?orfh. 
However, at least a 50 percent overage (i.e., half again as many draft 
questions prepared as will be needed in the final test version) would be 
considered a minimum in this regard. 

with III lltl^ ques $ ions ' after bei "9 Prepared and reviewed in accordance 

. h ' 58 dlSCU!5i0ns in the preceding sections, should be 
Sfthin P^ri L "° ° r . BOre , k 5iBilar Parallel forms for trial administration. 
Within each test section, the questions should progress in degree of 
se?H^ 1Ca J i0n antic fP a J ed d iHiculty, so that at the beginning of each 
material. (As indicated previously, however, even the more challenging 

win ha°v n : ! 0 ? ld 6 Hr \\ ten ! SUCh 8 Hay that the 1655 Proficient examinee 
■ll it i at east something to say about the situation or topic, albei t not 
with the level of sophistication and accuracy expected of examinees at or 
beyond the level "targeted" by a particular question.) 

i»n„rf ( !nf In ad ? it i on t0 tne test section-specific considerations, other 
important points for review are as follows: 



ERIC 
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and 0 ; a a It! nd%^ « ^ar ! e^^^p uVllTn ""f' Z W «'' ^io.atic, 
the language? ^nety acceptable to virtually all educated speakers of 

authenUc ? % 0 \Y^^ VerbaU f y defi " ed Situat *°- Rurally 

learner would reason b ex e 9 "l!"" " tS t k hat a " Engl i sh-speaki n,/ 
native speakers of the Ungua n ° '^7" C ° ntacts with 

country? ge ' eitner ln the U.S. or in the target language 

undersun2a^rb\^aifn\es r " t a°r: 'I"!' t0 the P ° int ' and >-«ly 
anticipated for th" "est" t h 0 uah L ! dU " ti0n and ^neral knowledge 
precision of terminology win bl tin ! J 69 " 6 ° f SOphi sti cati °" and 
certain of the q e " ( e a "In' 6 ''V"""^ «t the stage" for 
and 'situations' sections ! care 11^ 3 J he f [ eS P 0nses to Panted questions- 
English as simple and r t d ^ 5 t ; f kee P the printed and spoken 
adequately conveying the response U^ks af issul' C ° nSlStent " ith 

*■« - a 

examinee performance at ?ssue from'feveU? to^/l^^n^?^"^^^^^ & 
ASSEMBLY AND TRIAL ADMINISTRATION OF DRAFT TEST FORMS 

-ster'apllnrtn^^f 3 !:,:!: ?° ^ ! P-P-ati on of test booklets and 

speakers of the 1 anguage and ear ne s VL^i°\ ° • the J"' t0 both "«"v. 
P^ion. Procedu^ of the intended examinee 

the test blkU^ to prepare both 

•aster test tape. This great 1 v% ac ta?L In** 1 " 9 5 * ' h 6 SCript for the 
also a major timeiaver in the p'repa a o of Jnt'^V^ 1 ater chan 9 es « and " 
"shells- giving , the overall fo?ma ^ and ?hp „ k Pl " ^ St f ° rns < since uni '°™ 
directions) portions of ?he est can L Rr ^ "J ' ^ 9 " ' general 
for all forms. St be P re Pared and used as the basic template 

«) For the test booklet, format considerations include the following: 

inst-ted^^ feS?.'!' "ver, with the examinee 

(For the Chinese Speaking Test thp oil K 10 ^ to do so by the taped voice, 
-simulated convers^ remains closed until the 

righ^.nd^ 

page. In this way, max 'c r * xlmi ee^r" test a n'ew 

ne tiatter and the pages are much less 
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likely to become detached. 



uiy printed at. the bottom of each right-hand page, 
(e) Paper stock should be sufficienMw h = , 
through." Since it is anticipated hat Hin t I f nd ? PaqUe t0 prevent "»e- 
■ ultiplt administrations Ue examine rfo f St b °° klet WiU serve 'or 
booklet,, heavier pape s oc I"? a "o l e lT T" - 'Vf ° ther " iSe " rk the 
booklet. also Ie "9then the useful life of the 

full-^e^nc?! ^^S'^t'i:'}!:!',." " SU " icient to with clear, 

artist would ulti.at "?„ 'i fo the lin^ 9 ' ".''J thB drawin S s that th 
changes can be readi ly'a d rela i ve y i exnL^ 0 ^ ' In thiS " a ^ a "V ""ded 
version. relatively inexpensively incorporated into the final 

(3, Suggestion, tor bb. Up, , cript and ,„ tjpe 

foiled .Mediately by the next question. It In, L V " ch '«••«•"«, 

responsib.lity t„ stop the .aster tane Ttt.r I ' ne test adainistrator 's 

exe.inee as .uch ti.e as necessary to t c \lT" ' ind then ">. 
version of, he test, predetermine, s " i es Pe'"^^-, " ' he 

t-n jst:: ::r; ..^r:,^ 0 :'? ^'m- ». ........ t . 

ti.ings should be sho.n in the ,cr"»t a ?I. P ° ke " St£ip " "■••»d. flu , U ch 
spaced scripts are easier to read ano hanjfl ap,,rI " lr ' ate '-"lions. Double- 
are single-spaced. " a " dle ' "cording studio setting than 

'donv,;..^ w <"»«°» <" the 

dialect .ith a ood'^c 5 ic a e " 3 i f d " , 1 tiv, 1 ^.*T *»• 't«d.rt 

characteristics. Sincpfho a I regional or idiosyncratic 

single speaker 'it^ou d' ZZll l\V tl\lkT^ *° " ith a 

Each question should be spoken once at V Ta' " 8 5in9le voice - 
conversational pace. P ' 1 a relaxed ^ut not artificial ly slow, 

train^ 

the recording session, qualified 1 sJeners r^h! ng/ ! dUCati ° nal J,aterial - At 
the English and target L ua e s ea ers shou 0 ! S J"!* u11 ). """Coring both 
hesitate to call for as many "takes 8 as „ B ,° n "and, and should not 

recording. "any takes as necessary to secure a high quality 

included in the final 'est form? th- 111, than ultimately be 

ed„ f . t .d r;„.« v . ^....^■i^fEr • jj: t 'r::,-:;:'-,,^- -ri;^;:--.^-.^ ■ 
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issue in this tryout are: 



auest^L A " UraC K y and f ad6qUaCy ° f the sti » ul "s Questions. Do the test 
questions in each section, including the situation descriptions elicit the 

oelw a : eSP ° nSe ! D ° the higher-level^eifio; "yil " at - 

speaker answers at the expected level of sophistication, discourse style, etc 

Dirtnrp'n^ 6 1 h er e amb 1 9 U * 1 * " in any aspect of the line drawings? For the 

e icriot- as' i°t n h S e a I„t S ^ U % nC : ° # PiCtUreS ' d ° the native s P" k - s *<°»°» 
tne script as to the anticipated responses? 

(c) Do any of the test questions or other aspects of the test strike th» 
native speakers as linguistically unnatural, culturally JueJtionable! etc.? 

(d) Do the native speakers take roughly similar amounts of time to answer 
a given question? The typical native response ti.e aay be considered a 
«"nmu» . which will usually need to be increased fnr Inn Ll 

discussion below). increased for non-native examinees (see 

trvoutf IV^Il any / evi5ions indicated on the basis of the native-speaker 
o-one ba s tl 8 ?0 ' aterials sh °"H then be ad.i ni stered-agai n on a o - 
eve? 1 tl ill. Wru distributed as evenly as possible over the 

level 1 to level 3/,i+ range. The following are especially to be noted: 

ti.es'jor"^ is the range of response 

tiaes for each of the test questions? It should be possible for each 

sir ;»;„ «^ii' v t : r,W"< e °' resp °" e »»« ; « <" •< 

tne examinees appear -to fall , discounting, as necessary, abnormal lv brief 

I STgarr ^ oIs a rioJv S bv at l0 ?f St °< the -ale rnd/or°i: a ccas , 
quite^garrulous reply by a more fluent examinee. The resoonse time finallv 

den" fi SV° r " n ve "" u "tion should tend toward th " " * 

identified range. As a rough estimate o* suitable response ti.es, which shoulo 

K. ■ ;5«;:?S"jir " r-:»?pT=^rv=iTr. adopted , or a ™: n ;:;■;„; h g d 

cne following are the timings used in the Chinese test project: 
Simulated Conversation: 5-20 sec. 

Picture Descriptions: 75 sec> 

Responses to Printed Questions: 75-90 sec. 

Situations: 30-90 sec. 

(i.e '"live or y ,?!e ffi n he f* an,inees seem to 9° "off track" in their responses 
Hi*'' 9 ve ° r attempt to give answers that are not at all in keeoino with the 
intent of the nuest i on ) "> w cn «. k „ . , , in Keeping wi tn tne 

question, with possible implications for revision. 

testinn , r^ r h C J Ured CO " versation "ith the examinees immediately following the 
that the examinee considered "unfair." etc Since fh„ • • 

.x.. 1 „., .„.„ r „,,„,„. t0 hindU ., p , rtuul ; r topjcv't^rorju;.;;;: „ 
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!II! r ?iii , I i 5! 1 ar !!* Ho " e r er ' if several otherwise fluent examinees appear to 
have blocked" on the word for a particular object or action in one of the 
drawings, or in some other way been appreciably hindered by the lack of a 
particular lexical item, consideration should be given to revising the question 
to minimize or eliminate this particular stumbling block. 

FINAL TEST PRODUCTION AND ADMINISTRATION 

In view of the fact that the tryout version of the test will contain 
somewhat more questions than are to be used in the final version, it will be 
possible at this point to remove from further consideration questions that 
appear to have quality deficiencies of any type and to concentrate on those 
questions which have been found to operate substantially in the manner 
intended. Any necessary corrections or modifications should, of course, be 
made to the retained questions with respect to both the printed text/pictures 
and the recorded script. Some judgment will be required concerning whether the 
tape script should be re-recorded in its entirety or whether it will be 
possible to simply -strip in" any needed corrections on the original master 
tape. As a general matter, unless the changes are quite minor and the services 
of a professional recording studio are available to insure, for example, that 
the recording level of the inserted material closely matches the original 
level, it is preferable to re-record the entire test tape, with, of course, the 
same cartful during- and after-recording review that was carried out for the 
trial version. 

Once the proof copy of the final master tape is available and the camera- 
ready copy for the test booklet has been prepared (with the latter morked-up 
into the exact format and pagination that will be used in the printed version), 
at least one — and preferably more— qualified reviewers should attentively 
"take" the test, from beginning to end, by listening to the tape and followinq 
all of ..he directions provided. It is at this stage that any remaining 
problems *ill need to be caught (for example, insufficient time for page 
turning, mis-numbered pages, etc.). 

If possible, offset printing, rather than xeroxing or other similar 
process, should be used to produce the test booklets. Particularly for the 
line drawings, offset-quality printing is necessary to provide highly legible - 
and unambigous reproduction. As previously indicated, opaque, somewhat heavier 
than normal paper stock is recommended, especially if the booklets are to be 
reused several times. Side- or saddle-stapling is recommended so that the 
pages will lie flatter and the booklet will be more physically secure than with 
corner stapling. 

, . ™ e completed test is readily admi ni sterabl e either in a language 
laboratory equipped for student recording or, on an examinee-by-examinee basis, 
by means of two portable tape recorders, one to play the tape and the other to 
record the examinee's voice. For language lab administration, examinees should 
be seated as far from one another as possible, to minimize deliberate or 
inadvertent "listening in" to other examinees' responses. 



TEST SCORING 



devel^elf of'th!! ** 1*° f egi " ning ° f this ma " u ^ . the conceptualization and 
development of the particular type of test described here is aimed at 

imp ementing, in a semi-direct format, the proficiency testing approach and 

efforts t r h ° Pe V Y ACTFL/I !; R ° ther a9encieS «»«bor.tin B in these 
efforts. It is, therefore, considered absolutely necessary for persons 

t a hfrf!^ g fi°K 0Perat i 0nalIy evaluate «"in.. performance by means of a test of 
au pi es o ACm lr III™ * #U " * ^^/ratsr training program under the 
auspices of ACTFL or other recognized agency, so as to be able to validly and 
rel ably apply the same evaluation process and standards to the semi-uirec' 
instrument. Information concerning the availability and scheduling of 
interviewer/rater training workshops conducted by ACTFL or other qualified 
training sources may be obtained by contacting the American Council on the 
Teaching of Foreign Languages, 579 Broadway, Hasti ngs-on-Hudson , NY 10706. 

Experience gained during the test scoring and validation phases of the 
Chinese Speaking Test project suggests that linguistically qualified 
individuals who have successfully completed a comprehensive ACTFL-type 
interviewer/rater training program should be able to readily transfer these 
evaluation standards and skills to similar assessments of examinee performance 
based on responses to the semi-direct test. Since the latter type of tesUng 
work is still in its early stages, there has not yet been the opportunity to 

o!rt cullr ?o g fh infr ; StFUC i U :! °- aux i liar y information and shared experience 
particular to the rating of the semi-direct tests per se. However, it is CAL's 



intent to serve as an infernal clearinghouse for information, suggestions, and 
accounts-o -experience with the development and evaluation o both the present 
semi-direct tests m Chinese and similar tests in other languages that may 
developed in^the future. Persr -s or institutions who would like to receiv. 
share any relevant information are asked to contact the Center for Applied 
Linguistics, 1118 22nd Street, NW, Washington, DC 20037. 
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Questionnaire for 



Part ici pants 



in Chinese Speaking 



Test Study 



We would very much appreciate your answers to the following 
questions, concerning the three speaking tests (live interview 
plus two tape-recorded tests) which you took in connection with 
the Chinese Speaking Test study. We are asking for your name on 
the form simply as a check that the questionnaire has be-, 
received. All information will be analyzed on an anonymous' 
group basis for purposes of test improvement . Thank you in 
advance for your comments, and for your much-appreciated 
participation in the test development process. 

1. Over the course of the live _inter view , do you feel that your 
maximum level of speaking ability in Chinese was adequately 
probed by the tester? 4 y 

( ) Yes ( ) No 

Any comments on this question? 



2. Over the course of the taped _ test, do 
descriptions, narratives, situations, ' and 
questions in the test were adequate to probe 
of speaking ability i n Chinese? 

( ) Yes ( ) No ? 

Comment on this question? 



you feel that the 
other types of 
your maximum level 



3. In the liYe_jn_te_rvJew, were there any questions asked or 
"Shfair"? SitUat ' i0nS required which you felt were in any way 

( ) Yes 
( ) No 

Of "Yes, "please briefly describe the question(s) involved. ) 
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Questionnaire— Chinese Speaking Test Study 

any way "unfair"? hat you felt w *re in 

( ) Yes ( ) No 

(If "Yes," please describe briefly.) 



5. In which of the two tvnpc: of 

test— did you feel th, II ■ test — live interview or taped 

uiq you Tee i the more anxious or nervous? 

( ) Live interview 

( ) Taped test 

( ) Both were about the same 
Comments? 



6 Which of the two types of tests did you feel w ' as . tho « 
difficult? iee i was the more 



C ) Live interview 

( ) Taped test 

C ) Both were about the same 
Comments? 



7 • During the taped test, were the nau^o- * 

usually long enough for you to respond a , your response 

were able)? sponcl a * tul iy as you wished (or 

() Pauses were usually too short 
C ) Pauses were usually about right 

•V: ( .: ■•:): Pauses were usually too long 
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Quest io„n a1 re--CMnese S peaM„ g Test stody 
Comments? 



8 - In the taped test, were th« a< ' . 

prt. of th . test suffl . c1ent - ;%j:z°v™u:% the diff "- n « 

< > Yes ( ) No 



Comments? 



9. Assuming that you would receive ^ D 

techniques, would you persona l" y ra t ^ "° re ^ough both 

• (-ng,.) taped test 1n order % ^o^pU^ ^1^" " 

( ) I would rathpp f a L„ -, . 

take a live interview because- 

( ) I would rather t*Lr D =, «- - 

take a taped test because: 

( ) I have no real preference 
10. Please use the sob k 

live interview or th/tap. ^ t^t haT?"' T ^ 3SpeCt of the 
the_ preceding questions. We would all •°, COvered any of 

to how these testing P-cedurer^hr^m^v^ 



Thank you very much for your help 



Name 



